hi, i'm rob

Infrastructure & Operations

125 activities

filed bug #1715749 in Infrastructure & Operations

rotate cot keys on gecko-3/b-win2012

thursday, june 10, 2021 — 11:18:06 utc

filed bug #1715009 in Infrastructure & Operations

Fatal Python error: Py_Initialize: can't initialize sys standard streams

monday, june 7, 2021 — 13:27:47 utc

filed bug #1682266 in Infrastructure & Operations

select appropriate vm size for win7/win10 tests

monday, december 14, 2020 — 11:37:29 utc

filed bug #1676850 in Infrastructure & Operations

tracker: green up test suites on azure windows worker types

thursday, november 12, 2020 — 13:07:39 utc

filed bug #1671033 in Infrastructure & Operations

OCC terminates instances for missing task drives before ec2config has mapped task drives

tuesday, october 13, 2020 — 20:58:06 utc

filed bug #1633369 in Infrastructure & Operations

get cloud-image-builder integrated with ci-configuration

monday, april 27, 2020 — 11:20:36 utc

filed bug #1604423 in Infrastructure & Operations

get occ ci working again under the firefox-ci taskcluster deployment

tuesday, december 17, 2019 — 08:43:29 utc

filed bug #1588757 in Infrastructure & Operations

send system logs to stackdriver rather than papertrail

tuesday, october 15, 2019 — 11:26:00 utc

filed bug #1587036 in Infrastructure & Operations

the gecko-t-win10-64-hw pool is boot looping and not taking tasks

tuesday, october 8, 2019 — 10:38:35 utc

filed bug #1582726 in Infrastructure & Operations

download of artifacts from queue.taskcluster.net fails with CERTIFICATE_VERIFY_FAILED on gcp windows builds

friday, september 20, 2019 — 13:03:40 utc

filed bug #1572076 in Infrastructure & Operations

[Ronin Windows] Add support for gecko-t-win10-a64 yoga (aarch64) workerTypes

wednesday, august 7, 2019 — 13:12:09 utc

filed bug #1570262 in Infrastructure & Operations

test installation of scoop and google chrome to the task user profile on windows infra

wednesday, july 31, 2019 — 10:19:46 utc

filed bug #1570213 in Infrastructure & Operations

test installation of google chrome on windows infra

wednesday, july 31, 2019 — 05:40:11 utc

filed bug #1566787 in Infrastructure & Operations

create gcp service accounts for cloudops

wednesday, july 17, 2019 — 10:41:29 utc

filed bug #1558192 in Infrastructure & Operations

aarch64 bitbar yoga workers do not run occ between tasks

monday, june 10, 2019 — 14:08:23 utc

filed bug #1555360 in Infrastructure & Operations

Install Japanese Language support on Windows 10 instances

wednesday, may 29, 2019 — 14:20:01 utc

filed bug #1553572 in Infrastructure & Operations

run test suites on windows 10 may 2019 release 1903

wednesday, may 22, 2019 — 18:21:21 utc

filed bug #1552917 in Infrastructure & Operations

re-enable parallel gcp builds at tier 3 for linux, android & macosx

monday, may 20, 2019 — 17:57:52 utc

filed bug #1552503 in Infrastructure & Operations

disable parallel gcp builds

friday, may 17, 2019 — 14:35:20 utc

filed bug #1551827 in Infrastructure & Operations

patch windows 7 workers with kb4499175

wednesday, may 15, 2019 — 10:41:12 utc

filed bug #1551642 in Infrastructure & Operations

move gcp provisioning of workers to the newly created scm-level-specific gcloud projects

tuesday, may 14, 2019 — 17:37:29 utc

filed bug #1550468 in Infrastructure & Operations

modify temporary gcp provisioner to provision gecko builder instances in us regions only

thursday, may 9, 2019 — 13:12:27 utc

filed bug #1548370 in Infrastructure & Operations

gcp builds fail to create z:\build symlink causing early build failures

wednesday, may 1, 2019 — 20:20:25 utc

filed bug #1543026 in Infrastructure & Operations

enable sccache on windows gcp builders

tuesday, april 9, 2019 — 09:06:17 utc

filed bug #1530636 in Infrastructure & Operations

fix invalid manifest urls

tuesday, february 26, 2019 — 10:16:00 utc

filed bug #1527970 in Infrastructure & Operations

remove broken tooltool precache from windows worker types

thursday, february 14, 2019 — 17:59:36 utc

filed bug #1524180 in Infrastructure & Operations

gpg4win installer throws an error if already installed and dirmngr service is running

thursday, january 31, 2019 — 07:22:58 utc

filed bug #1522896 in Infrastructure & Operations

Update taskcluster Windows 10 workers to build 1803 (from 1703)

friday, january 25, 2019 — 17:22:47 utc

filed bug #1522762 in Infrastructure & Operations

log the occ dsc run in real time

friday, january 25, 2019 — 07:42:22 utc

filed bug #1520432 in Infrastructure & Operations

support occ run on aarch64

wednesday, january 16, 2019 — 10:55:08 utc

filed bug #1512090 in Infrastructure & Operations

support worker type overrides on hardware (to allow allocation of temporary beta workers)

tuesday, december 4, 2018 — 23:23:14 utc

filed bug #1512056 in Infrastructure & Operations

create new worker type(s) to support testing firefox on windows 10 for arm64

tuesday, december 4, 2018 — 20:34:17 utc

filed bug #1509974 in Infrastructure & Operations

move awsy (windows10-64-qr) from hardware to virtual-with-gpu on windows 10

monday, november 26, 2018 — 19:39:46 utc

filed bug #1509973 in Infrastructure & Operations

move reftest from hardware to virtual-with-gpu on windows 10

monday, november 26, 2018 — 19:37:21 utc

filed bug #1509722 in Infrastructure & Operations

disable windows defender and supporting services

sunday, november 25, 2018 — 16:05:35 utc

filed bug #1509103 in Infrastructure & Operations

create a dedicated worker type to test 1803

wednesday, november 21, 2018 — 17:25:33 utc

filed bug #1505455 in Infrastructure & Operations

time sync is failing on windows 7 workers

wednesday, november 7, 2018 — 16:57:17 utc

filed bug #1505384 in Infrastructure & Operations

disable windows activation by ec2config service

wednesday, november 7, 2018 — 14:18:57 utc

filed bug #1504971 in Infrastructure & Operations

refactor rundsc.ps1 so that all processing happens inside a function

tuesday, november 6, 2018 — 10:27:06 utc

filed bug #1502598 in Infrastructure & Operations

find source of exception: Amazon.SimpleSystemsManagement.AmazonSimpleSystemsManagementException

saturday, october 27, 2018 — 07:19:09 utc

filed bug #1501609 in Infrastructure & Operations

clean up papertrail log messages

wednesday, october 24, 2018 — 10:05:25 utc

filed bug #1500877 in Infrastructure & Operations

remove support for deprecated loaner functionality in occ

monday, october 22, 2018 — 11:00:28 utc

filed bug #1499077 in Infrastructure & Operations

reduce downloads from tooltool on occ instances

monday, october 15, 2018 — 14:36:13 utc

filed bug #1499013 in Infrastructure & Operations

Add taskcluster integration to github.com/mozilla-platform-ops/relops_image_builder

monday, october 15, 2018 — 09:23:27 utc

filed bug #1497308 in Infrastructure & Operations

instances occasionally identify as "taskcluster" in papertrail

monday, october 8, 2018 — 18:46:17 utc

filed bug #1495035 in Infrastructure & Operations

take product versions into account for msi, exe and zip installs/downloads

friday, september 28, 2018 — 17:54:32 utc

filed bug #1478670 in Infrastructure & Operations

occ run is terminating without running dsc, causing hg cache access failures

thursday, july 26, 2018 — 14:27:01 utc

filed bug #1476930 in Infrastructure & Operations

reduce complexity of the generic-worker wrapper script

thursday, july 19, 2018 — 12:45:41 utc

filed bug #1474548 in Infrastructure & Operations

Build an EC2 Windows AMI using automation

tuesday, july 10, 2018 — 10:29:27 utc

filed bug #1473835 in Infrastructure & Operations

validate ssh key ownership

friday, july 6, 2018 — 08:58:38 utc

filed bug #1463541 in Infrastructure & Operations

clean up c: drive on windows instances to reduce instance hangs due to full drives

tuesday, may 22, 2018 — 19:28:02 utc

filed bug #1463508 in Infrastructure & Operations

refactor instance age check logic to determine precise instance age

tuesday, may 22, 2018 — 17:49:49 utc

filed bug #1462452 in Infrastructure & Operations

log ssh access on windows workers and alert to irc

thursday, may 17, 2018 — 20:20:16 utc

filed bug #1460850 in Infrastructure & Operations

investigate what is causing explorer.exe to crash so frequently on windows workers

friday, may 11, 2018 — 12:03:57 utc

filed bug #1460535 in Infrastructure & Operations

migrate occ ci scripts to a python implementation

thursday, may 10, 2018 — 09:05:30 utc

filed bug #1457868 in Infrastructure & Operations

halt unproductive windows instances where explorer is in a crash loop

monday, april 30, 2018 — 12:50:32 utc

filed bug #1457416 in Infrastructure & Operations

implement fast occ rollback mechanism

friday, april 27, 2018 — 10:34:16 utc

filed bug #1456759 in Infrastructure & Operations

increase size of the c: drive on windows 10 taskcluster workers

wednesday, april 25, 2018 — 08:57:18 utc

filed bug #1456395 in Infrastructure & Operations

upgrade mecurial hg to 4.5.3 on taskcluster windows workers

tuesday, april 24, 2018 — 07:14:00 utc

filed bug #1454578 in Infrastructure & Operations

install an ssh server on taskcluster windows workers

tuesday, april 17, 2018 — 07:58:57 utc

filed bug #1443595 in Infrastructure & Operations

github binary downloads are broken in occ due to the tls upgrade

tuesday, march 6, 2018 — 19:19:13 utc

filed bug #1409144 in Infrastructure & Operations

cause occ ami deployment to fail when artifacts are missing from tooltool

monday, october 16, 2017 — 19:41:47 utc

filed bug #1409143 in Infrastructure & Operations

install carbon from tooltool instead of hg cloning it in occ

monday, october 16, 2017 — 19:37:53 utc

filed bug #1406354 in Infrastructure & Operations

refactor occ to pin instances to a specific occ revision

friday, october 6, 2017 — 11:38:15 utc

filed bug #1403490 in Infrastructure & Operations

enable mochitest-gpu tests on taskcluster windows 10

wednesday, september 27, 2017 — 09:19:20 utc

filed bug #1391189 in Infrastructure & Operations

rotate cot gpg keys for gecko-[1,2,3]-b-win2012

thursday, august 17, 2017 — 08:51:06 utc

filed bug #1384032 in Infrastructure & Operations

determine hardware capacity requirements for migrating win 10 gpu tests to hw

tuesday, july 25, 2017 — 09:12:00 utc

filed bug #1383618 in Infrastructure & Operations

Switch off general access to gecko level 3 windows builders

monday, july 24, 2017 — 06:38:25 utc

filed bug #1382625 in Infrastructure & Operations

Create a mechanism to cause EC2 GPU instances to default to the NVidia display adapter

thursday, july 20, 2017 — 12:19:34 utc

filed bug #1379603 in Infrastructure & Operations

Enable triggering of hardware and talos tests on TaskCluster Windows

monday, july 10, 2017 — 11:18:28 utc

filed bug #1377332 in Infrastructure & Operations

reduce inefficiencies created by spinning up taskcluster windows instances that never do any work

thursday, june 29, 2017 — 23:29:13 utc

filed bug #1377237 in Infrastructure & Operations

Add TaskCluster Windows 7 and 10 hardware tests to automation

thursday, june 29, 2017 — 20:29:25 utc

filed bug #1372172 in Infrastructure & Operations

investigate ec2 windows instances stalled in impaired state

monday, june 12, 2017 — 12:09:45 utc

filed bug #1360503 in Infrastructure & Operations

Update base AMI for Windows 10 Taskcluster worker types to Creators Update (build 1703)

friday, april 28, 2017 — 10:09:38 utc

filed bug #1359760 in Infrastructure & Operations

enable green tc win 10 tests

wednesday, april 26, 2017 — 10:23:54 utc

filed bug #1358067 in Infrastructure & Operations

Add key creation and chain-of-trust key submission to taskcluster windows ami generation

thursday, april 20, 2017 — 09:40:16 utc

filed bug #1351241 in Infrastructure & Operations

obtain generic-worker config secrets from tc-host-secrets on (re)boot of windows hardware workers

tuesday, march 28, 2017 — 08:57:31 utc

filed bug #1347500 in Infrastructure & Operations

admin password on tc win10 workers does not match tc secrets entry

wednesday, march 15, 2017 — 11:42:12 utc

filed bug #1342892 in Infrastructure & Operations

vendor occ installer artifacts from within mozilla infrastructure

monday, february 27, 2017 — 12:38:12 utc

filed bug #1341654 in Infrastructure & Operations

install taskcluster-host-secrets on dc puppet servers

wednesday, february 22, 2017 — 16:02:27 utc

filed bug #1336050 in Infrastructure & Operations

[tracker] create and deploy host-secrets service

thursday, february 2, 2017 — 10:24:40 utc

filed bug #1309380 in Infrastructure & Operations

remove duplication of mercurial config from userdata

tuesday, october 11, 2016 — 21:30:45 utc

filed bug #1295942 in Infrastructure & Operations

reinstate svn sysadmins access for rthijssen

wednesday, august 17, 2016 — 11:36:47 utc

filed bug #1287417 in Infrastructure & Operations

Pull userdata powershell module from github rather than puppet server

monday, july 18, 2016 — 12:16:28 utc

filed bug #1286549 in Infrastructure & Operations

prevent puppet from running on t-w732-spot-* instances

wednesday, july 13, 2016 — 14:03:13 utc

filed bug #1255509 in Infrastructure & Operations

Fix setting of puppet server in cloud tools for windows instances

thursday, march 10, 2016 — 18:04:44 utc

filed bug #1246483 in Infrastructure & Operations

send ec2 windows userdata logs to papertrail

sunday, february 7, 2016 — 12:33:12 utc

filed bug #1246397 in Infrastructure & Operations

puppettize.vbs partial failure (failed to extract 2 of 3 keys from certs file)

saturday, february 6, 2016 — 14:48:53 utc

filed bug #1242146 in Infrastructure & Operations

getcert.cgi not returning certs for y-2008-ec2-golden

saturday, january 23, 2016 — 14:14:03 utc

filed bug #1241820 in Infrastructure & Operations

Windows ec2 golden instances should obtain a new puppet cert on each instantiation

friday, january 22, 2016 — 10:11:44 utc

filed bug #1232997 in Infrastructure & Operations

Create EC2 NxLog template definitions for t-w732 & t-w10

wednesday, december 16, 2015 — 13:03:47 utc

filed bug #1230427 in Infrastructure & Operations

ssh server on {b,y}-2008-{spot,ec2} isn't working

friday, december 4, 2015 — 04:25:08 utc

filed bug #1229907 in Infrastructure & Operations

Add buildbot-master{128,129} to nagios

wednesday, december 2, 2015 — 20:34:23 utc

filed bug #1229791 in Infrastructure & Operations

Create slave alloc pools for t-w732 and t-w10 AWS slaves

wednesday, december 2, 2015 — 15:41:50 utc

filed bug #1229790 in Infrastructure & Operations

Create AWS test buildbot masters for t-w732 and t-w10 slaves

wednesday, december 2, 2015 — 15:41:45 utc

filed bug #1221197 in Infrastructure & Operations

Shift TRY load from b-2008-ix to y-2008-spot

tuesday, november 3, 2015 — 17:34:11 utc

filed bug #1221196 in Infrastructure & Operations

Shift TRY load from b-2008-ix to y-2008-spot

tuesday, november 3, 2015 — 17:34:11 utc

filed bug #1205640 in Infrastructure & Operations

investigate low frequency of event log messages to papertrail from ec2 2008 instances

thursday, september 17, 2015 — 13:09:49 utc

filed bug #1202440 in Infrastructure & Operations

Windows spot instances are not terminated if they are disabled in slavealloc

monday, september 7, 2015 — 14:44:38 utc

filed bug #1200605 in Infrastructure & Operations

include (b|y)-2008 spot instances in slave health

tuesday, september 1, 2015 — 13:24:13 utc

filed bug #1199267 in Infrastructure & Operations

investigate build failures on y-2008-spot instances

thursday, august 27, 2015 — 15:06:16 utc

filed bug #1198317 in Infrastructure & Operations

reduce the number of available b-2008-ix instances in TRY in order to force y-2008-spot instantiation

tuesday, august 25, 2015 — 15:56:26 utc

filed bug #1197768 in Infrastructure & Operations

Disable Microsoft Telemetry for Windows 10 testers

monday, august 24, 2015 — 11:20:20 utc

filed bug #1197182 in Infrastructure & Operations

include (b|y)-2008 spot / golden amis in cloud-tools ami cleanup

friday, august 21, 2015 — 12:55:02 utc

filed bug #1195880 in Infrastructure & Operations

switch off windows updates in ec2 userdata

tuesday, august 18, 2015 — 17:36:57 utc

filed bug #1195877 in Infrastructure & Operations

pass a puppet_server token to 2008 ec2 userdata

tuesday, august 18, 2015 — 17:34:13 utc

filed bug #1195368 in Infrastructure & Operations

trigger spot instantiation for windows 2008 build/try instances in EC2 from buildbot config

monday, august 17, 2015 — 15:58:48 utc

filed bug #1193789 in Infrastructure & Operations

reduce the size of the userdata file passed to Windows Server 2008 EC2 instances

wednesday, august 12, 2015 — 15:17:24 utc

filed bug #1192779 in Infrastructure & Operations

Windows spot instances labelled as linux

monday, august 10, 2015 — 11:29:55 utc

filed bug #1192760 in Infrastructure & Operations

Add windows golden ami generators to cron

monday, august 10, 2015 — 10:09:19 utc

filed bug #1191717 in Infrastructure & Operations

Work out and fix the reason why 2008 spot instances do not call home

thursday, august 6, 2015 — 09:32:42 utc

filed bug #1191046 in Infrastructure & Operations

prevent sysprep from running on windows golden/spot instances

tuesday, august 4, 2015 — 20:24:26 utc

filed bug #1188928 in Infrastructure & Operations

assign b-2008 and try-2008 spot runners in slavealloc

wednesday, july 29, 2015 — 15:55:21 utc

filed bug #1186542 in Infrastructure & Operations

issues with b-2008, try-2008 userdata in build-cloud-tools

wednesday, july 22, 2015 — 18:38:52 utc

filed bug #1185916 in Infrastructure & Operations

Set Windows spot instance hostnames

tuesday, july 21, 2015 — 09:21:19 utc

filed bug #1185909 in Infrastructure & Operations

Update the puppet runner manifest to handle windows installs

tuesday, july 21, 2015 — 09:16:25 utc

filed bug #1183547 in Infrastructure & Operations

[tracker] Non-Blocking issues for Deploying Puppet Configured 2008 in AWS

tuesday, july 14, 2015 — 09:01:58 utc

filed bug #1183545 in Infrastructure & Operations

[tracker] Blockers for Deploying Puppet Configured Windows Server 2008 in AWS

tuesday, july 14, 2015 — 08:45:24 utc

filed bug #1183542 in Infrastructure & Operations

[tracker] Build Functionality Blockers for Deploying Puppet Configured 2008 in AWS.

tuesday, july 14, 2015 — 08:43:57 utc